Camera enhanced with light detecting sensor

ABSTRACT

A method includes generating, by a camera of a monitoring system that is configured to monitor a property, first image data at a first time, analyzing the first image data, determining that the first image data includes a first object that likely corresponds to a person, generating, second image data at a second, later time, analyzing the second image data, determining that the second image includes a second object that likely corresponds to a person, comparing the first object that likely corresponds to a person to the second object that likely corresponds to a person, based on comparing the first object that likely corresponds to a person to the second object that likely corresponds to a person and based on a difference between the first time and the second, later time, determining that a person is likely moving towards the camera, and performing a monitoring system action.

CROSS REFERENCE TO RELATED APPLICATIONS

This application is a continuation of U.S. application Ser. No.15/938,725, filed Mar. 28, 2018, now allowed, which claims the benefitof U.S. Provisional Application No. 62/477,522, filed Mar. 28, 2017, andtitled “Camera Enhanced with Light Detecting Sensor.” Both of theseprior applications are incorporated by reference in their entirety.

TECHNICAL FIELD

This disclosure relates to property monitoring technology and, forexample, the use of consumer and commercial video surveillance camerasequipped with light detecting sensors in a property monitoring system.

BACKGROUND

Many people equip homes and businesses with monitoring systems toprovide increased security for their homes and businesses.

SUMMARY

Techniques are described for monitoring technology. For example,techniques are described for integrating a light detecting sensor, whichis low power and low resolution, with a camera to optimize the batterylife of the camera within a property monitoring system.

Implementations of the described techniques may include hardware, amethod or process implemented at least partially in hardware, or acomputer-readable storage medium encoded with executable instructionsthat, when executed by a processor, perform operations.

According to an innovative aspect of the subject matter described inthis application, a monitoring system that is configured to monitor aproperty includes a camera that is configured to generate first imagedata at a first time, and a monitor control unit that is configured toreceive the first image data and data indicating the first time, analyzethe first image data, and based on analyzing the first image data,determine that the first image data includes a first object that likelycorresponds to a person, where the camera is further configured togenerate second image data at a second, later time. The monitor controlunit is further configured to receive the second image data and dataindicating the second, later time, analyze the second image data, basedon analyzing the second image data, determine that the second image dataincludes a second object that likely corresponds to a person, comparethe first object that likely corresponds to a person to the secondobject that likely corresponds to a person, based on comparing the firstobject that likely corresponds to a person to the second object thatlikely corresponds to a person and based on a difference between thefirst time and the second, later time, determine that a person is likelymoving towards the camera, and based on determining that a person islikely moving towards the camera, perform a monitoring system action.

These and other implementations each optionally include one or more ofthe following optional features. The monitor control unit is configuredto perform the monitoring system action by providing, for output to thecamera, a command to capture video data at a resolution that is higherthan the first image and the second image. The monitor control unit isconfigured to perform the monitoring system action by providing, foroutput to a client device of a resident of the property, a notificationindicating that a person is likely moving towards the property. Themonitor control unit is configured to determine that the monitoringsystem is in an unarmed state and that an exterior door of the propertyis unlocked, and perform the monitoring system action by arming themonitoring system and locking the exterior door of the property.

The monitor control unit is configured to determine that the monitoringsystem is in an armed away state, and perform the monitoring systemaction by activating one or more lights at the property. The camera isconfigured to generate third image data at a third time and the monitorcontrol unit is configured to receive the third image data and dataindicating the third time, analyze the third image data, based onanalyzing the third image data, determine that the third image dataincludes a third object that likely corresponds to an animal, the camerais configured to generate fourth image data at a fourth time. Themonitor control unit is configured to receive a fourth image data anddata indicating the fourth time, analyze the fourth image data, based onanalyzing the fourth image data, determine that the fourth image dataincludes a fourth object that likely corresponds to an animal, comparethe third object that likely corresponds to an animal to the fourthobject that likely corresponds to an animal, based on comparing thethird object that likely corresponds to an animal to the fourth objectthat likely corresponds to an animal and based on a difference betweenthe third time and the fourth time, determine that an animal is likelymoving towards the camera or across a field of view of the camera, basedon determining that an animal is likely moving towards the camera oracross the field of view of the camera, perform an action to encouragethe animal to leave the property.

The camera is configured to generate third image data at a third timeand the monitor control unit is configured to receive the third imagedata and data indicating the third time, analyze the third image data,based on analyzing the third image data, determine that the third imagedata includes a third object that likely corresponds to a person, thecamera is configured to generate fourth image data at a fourth time. Themonitor control unit is configured to receive a fourth image data anddata indicating the fourth time, analyze the fourth image data, based onanalyzing the fourth image data, determine that the fourth image dataincludes a fourth object that likely corresponds to a person, comparethe third object that likely corresponds to a person to the fourthobject that likely corresponds to a person, based on comparing the thirdobject that likely corresponds to a person to the fourth object thatlikely corresponds to a person and based on a difference between thethird time and the fourth time, determine that a person is likely movingacross a field of view of the camera, based on determining that a personis likely moving across the field of view of the camera, determine notto perform a monitoring system action.

The monitor control unit is configured to determine that the thirdobject that likely corresponds to a person is represented by a firstnumber of pixels, determine that the fourth object that likelycorresponds to a person is represented by a second number of pixels, anddetermine that the second number of pixels is within a pixel thresholdvalue of the first number of pixels, determine that a person is likelymoving across a field of view of the camera based further on determiningthat the second number of pixels is within a pixel threshold value ofthe first number of pixels. The monitor control unit is configured todetermine that the first object that likely corresponds to a person isrepresented by a first number of pixels, determine that the secondobject that likely corresponds to a person is represented by a secondnumber of pixels, and determine that the second number of pixels isgreater than the first number of pixels, determine that a person islikely moving towards the camera based further on determining that thesecond number of pixels is greater than the first number of pixels. Thecamera includes (i) a first image sensor that collects image data at afirst resolution and uses a first amount of power and (ii) a secondimage sensor that collects image data at a second, higher resolution anduses a second, greater amount of power.

The details of one or more implementations are set forth in theaccompanying drawings and the description below. Other features will beapparent from the description and drawings, and from the claims.

DESCRIPTION OF DRAWINGS

FIGS. 1A and 1B illustrate examples of a system for determining when tosend a notification to a user.

FIG. 2 illustrates an example of a monitoring system integrated withcameras.

FIG. 3 is a flow chart of an example process for sending an alertnotification to a user.

FIG. 4 is flow chart of an example process for detecting a person movingtowards a camera.

DETAILED DESCRIPTION

Monitoring systems that include cameras that are “mains” or “wall”powered are configured to continuously run a camera module (CMOS andlens apparatus and video CODEC), and primary system monitor controlunit, as well as maintain a network connection. As such, a camera withinthis system is able to implement various processor-intensive and powerdemanding analytics, machine learning, and artificial intelligence (AI),to determine if movement seen within the field of view (FOV) of thecamera meet criteria set by a user. When the movement seen within thefield of view of the camera meets the user set criteria, a video clipcaptured by the camera and or an alert of the movement may becommunicated to the user. When a camera within the monitoring systemcaptures a video clip, the camera may upload the video to a host cloudservice via either a wireless or wired connection. The wirelesscommunication may be communicated via the Internet through a broadbandconnection or may be communicated via a cellular connection.

Wall powered camera systems may be limited in their utility as they mustbe located close to a power source. Some monitoring systems may includebattery operated cameras that do not limit the location of the cameraand allows the camera to be relocated. In order to be an effective andcompetitive product, a battery operated camera must have a reasonablylong battery life, and should not be burdened by unreasonably expensiveor large batteries. In some implementations, battery operated cameras donot have the power budget to operate continuously while being incontinuous communication with the Internet or host cloud service withoutsacrificing battery life. Battery operated cameras may integratelow-power motion detection technology, such as a Passive Infrared Sensor(PIR), that may detect heat radiated from objects to detect movement ofa living organism within the field of view of the sensor and cameralens. When movement is detected by the sensor, the camera maycommunicate with a processor within the monitoring system, the processorthen communicates with a camera module to begin capturing video. Theprocessor may also initiate a communication session to transmit thevideo files collected by the camera.

Techniques for integrating cameras within a monitoring system with a lowcost, low-power (low resolution) type sensor are described below. Thelow-power, low resolution sensor is different from the PIR sensor, andis configured to operate without communicating with the monitor controlunit, and thereby conserve battery power consumed during the process.Each of the cameras of the monitoring system may be integrated with asensor that is configured to have adequate resolution and sensitivity tolight. The sensor may be configured to collimate light such that anadequate number of regions of the field of view are collimated onto asufficient number of regions on the sensor, and may be configured toassess the amount of light striking the different regions of the sensor.In visual conditions other than total darkness, objects moving withinthe field of view of the camera may cause changes in the amount of lightreaching the light sensitive sensor, and based on the variations in thelight intensity, the camera may determine when an object is moving. Thesensor within the camera may determine whether the object is increasingin size, indicating the object is moving toward the camera, or maydetermine whether the object is decreasing in size, indicating theobject is moving away from the camera. The camera may be configured todetermine the shape of the detected object and may determine whether theobject is a human or animal based on the determined shape.

FIG. 1 illustrates an example of system for determining when to send anotification to a user. Each of the one or more cameras 102 may be avideo camera that is mounted to the external wall of a monitoredproperty. The monitored property may be a home or commercial property,and may be monitored by a security system that includes one or moreelectronic sensors. The monitoring system may include a control unit106, one or more sensors, and one or more cameras 102. The user 110 mayintegrate one or more cameras 102 throughout the monitored property.Each of the one or more cameras 102 on the exterior wall of the propertymay be equipped with a sensor that preserves battery life of the camera.The light sensors may be low cost, low-power sensors than can beoperated without waking up the high resolution sensor of the camera todetermine if movement within the field of view of the camera meets auser set criterion. If the movement meets a user set criteria, theprimary high resolution sensor of the camera is woken up, and the camerawould begin to capture video recordings of the movement. The user maythen be notified based on a user set criteria being met. The number offalse notifications that are sent to the user may also be decreased byincorporating the low lost light detecting sensor into the one or morecameras 102, and may only be sent when the event qualifies for the usersone or more different criteria.

As illustrated in 100A of FIG. 1A, the one or more cameras 102integrated with the light detecting sensors may detect object 104 movingwithin its field of view. The light detecting sensor in the camera maycollimate light on to the different regions of the field of view, andmay assess the amount of light striking different regions of the sensor.Based on the amount of light striking the different regions of thesensor, the sensor may identify that a moving object is within the fieldof view. The one or more cameras may determine the direction of movementof object 104 based on the variations in light intensity in differentregions of the light detecting sensor. The light detecting sensor maydetermine whether the size of the object 104 is increasing within thefield of view. An increase in the size of the object 104 may indicatethat the object 104 is moving toward the camera. As illustrated in thecamera sensor representation, at a first moment in time (I), the object104 is smaller than at the second moment in time (II), that is, theobject 104 is increasing in size within the field of view of the camera102. The light detecting sensor in the one or more cameras 102 may alsobe configured to determine the shape of the object, and may distinguishbetween a human form and an animal form. Based on the configuration ofthe light striking the light sensor and in the example in FIG. 1, thecamera 102 determines the human form of the object 104.

The user 110 may set one or more criteria for receiving notifications ofevents at the monitored property. The user may wish to receivenotifications only when the one or more cameras 102 detect human formswalking towards the monitored property. The user 110 may not beinterested in receiving a notification when the one or more cameras 12detect human forms walking along the side walk or walking across thestreet from the property. When the one or more cameras 102 detect theobject 102 is a human form and is walking towards the monitoredproperty, the camera's 102 high resolution sensor is woken up, and thehigh resolution sensor begins capturing video recording of the movement.The one or more cameras communicate the detected movement to the monitorcontrol unit 106 of the property monitoring system. The monitor controlunit 106 may then send a notification of the detected movement to theuser device 108 of the user 110. The notification may include the videorecordings captured by the one or more cameras 102.

As illustrated in 100B of FIG. 1B, the one or more cameras 102integrated with the light detecting sensors may detect movement withinits field of view by object 112. The one or more cameras 102 maydetermine the direction of movement of object 112 based on thevariations in light intensity in different regions of the lightdetecting sensor. The light detecting sensor may determine whether thesize of the object 112 is increasing or decreasing within the field ofview. A decrease in the size of an object would indicate an object ismoving away from the camera, or is translating across the sensor. Asillustrated in the camera sensor representation, at a first moment intime (I), the object 112 is smaller than at the second moment in time(II), that is, the object 112 is increasing in size within the field ofview of the camera 102. The light detecting sensor in the one or morecameras 102 may also be configured to determine the shape of the object,and may distinguish between a human form and an animal form. Based onthe configuration of the light striking the light sensor, the camera 102determines the animal form of the object 112.

When the one or more cameras 102 detect the object 112 is an animal formand is walking toward from the monitored property, the high resolutionsensor does not have to be woken up. The battery life of the one or morecameras 102 are preserved by only using power to wake up the highresolution sensor of the camera when the detected movement meets a userset criteria. The light detecting sensor may also determine that anobject 114 is walking by the monitored property. As illustrated in thecamera sensor representation, the object 114 may traverse the screen ofthe camera indicating the object is walking by the house. The camera mayalso determine the object 114 is a human form. When the cameras detectthe human form 114 is walking by the house, the user criteria are notmet, and the high power senor does not have to be woken up. The cameramay also reserve power by not having to communicate with the controlunit to send a notification to the user 110.

FIG. 2 illustrates an example of a system 200 configured to monitor aproperty. The system 200 includes a network 205, a monitoring systemcontrol unit 210, one or more user devices 240, and a monitoringapplication server 260. The network 205 facilitates communicationsbetween the monitoring system control unit 210, the one or more userdevices 240, and the monitoring application server 260. The network 205is configured to enable exchange of electronic communications betweendevices connected to the network 205. For example, the network 205 maybe configured to enable exchange of electronic communications betweenthe monitoring system control unit 210, the one or more user devices240, and the monitoring application server 260. The network 205 mayinclude, for example, one or more of the Internet, Wide Area Networks(WANs), Local Area Networks (LANs), analog or digital wired and wirelesstelephone networks (e.g., a public switched telephone network (PSTN),Integrated Services Digital Network (ISDN), a cellular network, andDigital Subscriber Line (DSL)), radio, television, cable, satellite, orany other delivery or tunneling mechanism for carrying data. Network 205may include multiple networks or subnetworks, each of which may include,for example, a wired or wireless data pathway. The network 205 mayinclude a circuit-switched network, a packet-switched data network, orany other network able to carry electronic communications (e.g., data orvoice communications). For example, the network 205 may include networksbased on the Internet protocol (IP), asynchronous transfer mode (ATM),the PSTN, packet-switched networks based on IP, X.25, or Frame Relay, orother comparable technologies and may support voice using, for example,VoIP, or other comparable protocols used for voice communications. Thenetwork 205 may include one or more networks that include wireless datachannels and wireless voice channels. The network 205 may be a wirelessnetwork, a broadband network, or a combination of networks including awireless network and a broadband network.

The monitoring system control unit 210 includes a controller 212 and anetwork module 214. The controller 212 is configured to control amonitoring system (e.g., a home alarm or security system) that includesthe monitor control unit 210. In some examples, the controller 212 mayinclude a processor or other control circuitry configured to executeinstructions of a program that controls operation of an alarm system. Inthese examples, the controller 212 may be configured to receive inputfrom cameras, sensors, detectors, or other devices included in the alarmsystem and control operations of devices included in the alarm system orother household devices (e.g., a thermostat, an appliance, lights,etc.). For example, the controller 212 may be configured to controloperation of the network module 214 included in the monitoring systemcontrol unit 210.

The network module 214 is a communication device configured to exchangecommunications over the network 205. The network module 214 may be awireless communication module configured to exchange wirelesscommunications over the network 205. For example, the network module 214may be a wireless communication device configured to exchangecommunications over a wireless data channel and a wireless voicechannel. In this example, the network module 214 may transmit alarm dataover a wireless data channel and establish a two-way voice communicationsession over a wireless voice channel. The wireless communication devicemay include one or more of a GSM module, a radio modem, cellulartransmission module, or any type of module configured to exchangecommunications in one of the following formats: LTE, GSM or GPRS, CDMA,EDGE or EGPRS, EV-DO or EVDO, UMTS, or IP.

The network module 214 also may be a wired communication moduleconfigured to exchange communications over the network 205 using a wiredconnection. For instance, the network module 214 may be a modem, anetwork interface card, or another type of network interface device. Thenetwork module 214 may be an Ethernet network card configured to enablethe monitoring control unit 210 to communicate over a local area networkand/or the Internet. The network module 214 also may be a voicebandmodem configured to enable the alarm panel to communicate over thetelephone lines of Plain Old Telephone Systems (POTS).

The monitoring system may include multiple sensors 220. The sensors 220may include a contact sensor, a motion sensor, a glass break sensor, orany other type of sensor included in an alarm system or security system.The sensors 220 also may include an environmental sensor, such as atemperature sensor, a water sensor, a rain sensor, a wind sensor, alight sensor, a smoke detector, a carbon monoxide detector, an airquality sensor, etc. The sensors 220 further may include a healthmonitoring sensor, such as a prescription bottle sensor that monitorstaking of prescriptions, a blood pressure sensor, a blood sugar sensor,a bed mat configured to sense presence of liquid (e.g., bodily fluids)on the bed mat, etc. In some examples, the sensors 220 may include aradio-frequency identification (RFID) sensor that identifies aparticular article that includes a pre-assigned RFID tag.

The one or more cameras 230 may be a video/photographic camera or othertype of optical sensing device configured to capture images. Forinstance, the one or more cameras 230 may be configured to captureimages of an area within a building monitored by the monitor controlunit 210. The one or more cameras 230 may be configured to capturesingle, static images of the area and also video images of the area inwhich multiple images of the area are captured at a relatively highfrequency (e.g., thirty images per second). The one or more cameras 230may be controlled based on commands received from the monitor controlunit 210.

The one or more cameras 230 may be triggered by several different typesof techniques. For example, the one or more cameras 230 may beintegrated with various light detecting sensors, such as ambient lightsensors or low-resolution CMOS sensors. Each of the one or more cameras230 may be configured to determine when an object is moving within thefield of view of the camera, and may determine whether the object isincreasing in size, indicating the object is moving toward the camera,or may determine whether the object is decreasing in size, indicatingthe object is moving away from the camera. Each of the one or morecameras 230 may be configured to determine the shape of the detectedobject and may determine whether the object is a human or animal basedon the determined shape.

The sensors 220, the detectors 222, and the cameras 230 communicate withthe controller 212 over communication links 224, 226, and 228. Thecommunication links 224, 226, and 228 may be a wired or wireless datapathway configured to transmit signals from the sensors 220, the packageholder devices 222, and the cameras 230 to the controller 212. Thecommunication link 224, 226, and 228 228 may include a local network,such as, 802.11 “Wi-Fi” wireless Ethernet (e.g., using low-power Wi-Fichipsets), Z-Wave, Power Over Ethernet (POE), Zigbee, Bluetooth,“HomePlug” or other Powerline networks that operate over AC wiring, anda Category 5 (CAT5) or Category 6 (CAT6) wired Ethernet network.

The monitoring application server 260 is an electronic device configuredto provide monitoring services by exchanging electronic communicationswith the monitor control unit 210, and the one or more user devices 240,over the network 205. For example, the monitoring application server 260may be configured to monitor events (e.g., alarm events) generated bythe monitor control unit 210. In this example, the monitoringapplication server 260 may exchange electronic communications with thenetwork module 214 included in the monitoring system control unit 210 toreceive information regarding events (e.g., alarm events) detected bythe monitoring system control unit 210. The monitoring applicationserver 260 also may receive information regarding events (e.g., alarmevents) from the one or more user devices 240.

The one or more user devices 240 are devices that host and display userinterfaces. The user device 240 may be a cellular phone or anon-cellular locally networked device with a display. The user device240 may include a cell phone, a smart phone, a tablet PC, a personaldigital assistant (“PDA”), or any other portable device configured tocommunicate over a network and display information. For example,implementations may also include Blackberry-type devices (e.g., asprovided by Research in Motion), electronic organizers, iPhone-typedevices (e.g., as provided by Apple), iPod devices (e.g., as provided byApple) or other portable music players, other communication devices, andhandheld or portable electronic devices for gaming, communications,and/or data organization. The user device 240 may perform functionsunrelated to the monitoring system, such as placing personal telephonecalls, playing music, playing video, displaying pictures, browsing theInternet, maintaining an electronic calendar, etc.

The user device 240 includes a native surveillance application 242. Thenative surveillance application 242 refers to a software/firmwareprogram running on the corresponding mobile device that enables the userinterface and features described throughout. The user device 240 mayload or install the native surveillance application 242 based on datareceived over a network or data received from local media. The nativesurveillance application 242 runs on mobile devices platforms, such asiPhone, iPod touch, Blackberry, Google Android, Windows Mobile, etc. Thenative surveillance application 242 enables the user device 140 toreceive and process image and sensor data from the monitoring system.

In some implementations, the one or more user devices 240 communicatewith and receive monitoring system data from the monitor control unit210 using the communication link 238. For instance, the one or more userdevices 240 may communicate with the monitor control unit 210 usingvarious local wireless protocols such as Wi-Fi, Bolt, Lora, Bluetooth,Z-Wave, Zigbee, “HomePlug,” or other Powerline networks that operateover AC wiring, or Power over Ethernet (POE), or wired protocols such asEthernet and USB, to connect the one or more user devices 240 to localsecurity and automation equipment. The one or more user devices 240 mayconnect locally to the monitoring system and its sensors and otherdevices. The local connection may improve the speed of status andcontrol communications because communicating through the network 205with a remote server (e.g., the monitoring application server 260) maybe significantly slower.

Although the one or more user devices 240 are shown as communicatingwith the monitor control unit 210, the one or more user devices 240 maycommunicate directly with the sensors and other devices controlled bythe monitor control unit 210. In some implementations, the one or moreuser devices 240 replace the monitoring system control unit 210 andperform the functions of the monitoring system control unit 210 forlocal monitoring and long range/offsite communication.

FIG. 3 illustrates an example process 300 for sending an alertnotification to a user. The light detecting sensor within the cameradetects an object in the field of view (310). The light detecting sensormay be an ambient light sensor with internal processing capability, ormay be a low resolution CMOS sensor with internal processing capability.The sensor may be configured to use very little power and may be a lowcost sensor. The sensor may collimate light on to different regions ofthe sensor and may be configured to assess the amount of light strikingthe various regions of the sensor. The sensor determines that an objectis within the field of view when the sensor detects changes in theamount of light reaching the light sensitive sensor. In someimplementations, an algorithm may be used by the sensor to calculate thechanges in light resolution within the field of view of the camera.

The sensor determines the direction of movement of the object (320). Thelight detecting sensor may determine the direction of movement of theobject within the field of view based on the variations in the lightintensity in different regions of the sensor. When an object is withinthe field of view, the presence of different areas of contrast andtemporal changes result in variations in the light intensity reachingthe different regions of the sensor. The sensor may determine when theobject is moving, and may determine whether the size of the object isincreasing within the field of view indicating that the object is movingtoward the camera. The sensor may determine when the object is moving,and may determine whether the size of the object is decreasing withinthe field of view indicating that the object is moving away from thecamera or is translating across the sensor. The sensor may also beconfigured to determine the shape of the object, and may distinguishbetween a human form and an animal form.

The sensor may determine whether a user set criteria is met (330). Thelight detecting sensor integrated into the camera may be a lowresolution CMOS sensor with internal processing capability (Low PowerVisual Sensor System), and may not require separate processor support todetermine whether a triggering event has occurred. A user may set one ormore criteria for a triggering event. For example, the user may only beinterested in recording video of a human walking toward the monitoredproperty. The user may not want to receive video of people walking bythe monitored property or walking away from the property. The user mayalso not be interested in video recording of an animal, such as a dog ora cat walking toward the property. Based on the user set criteria, thedetermination of the shape of the object, and the direction of movementof the object, the sensor may determine if the user criteria is met byemploying an algorithm.

The camera captures video recording of the object when the sensordetermines the user criteria is met (340). When the sensor determinesthat the user criteria is met, the camera may be activated to begincapturing high resolution video recordings of the object within thefield of view. The monitoring control unit sends an alert notificationto the user (350). The camera may be in communication with themonitoring control unit, and may communicate the captured videorecording to the monitoring control unit. The monitoring control unitmay communicate an alert notification that includes the captured videorecording to the user's mobile device.

While video surveillance camera systems typically have ambient lightsensors to allow the system to change exposure and enter night or daymode as ambient light conditions change, these sensors lack theresolution and/or processing capability to function in the mannerdescribed. The Low Power Visual Sensor System requires ambient light ofa sufficient brightness to function properly and therefore may providelittle value in low ambient light conditions. During such low ambientlight conditions, the camera may rely on the PIR sensor capabilities.Given the low-power and low-cost of the Low Power Visual Sensor Systemhowever, and considering that more movement in the FOV of the camerasystem is generally likely to occur during the day, the Low Power VisualSensor System could be employed during conditions with adequate ambientlight and given their enhanced capabilities compared to the PIR sensor,they may provide a reduction in the number of false positives. Thisreduces the number of times the less power efficient components in thesystem must wake, thereby extending battery life. The combination of theLow Power Visual Sensor System technology, with the PIR sensor andcamera system, creates an enhanced system for battery operated camerasfor the purpose of optimizing battery life.

FIG. 4 illustrates an example process 400 for performing a monitoringsystem action. The monitor control unit 106 receives, from a camera atthe property, a first image generated at a first time and dataindicating the first time (410). The camera may be a battery poweredcamera that is mounted to an exterior wall of the property, and mayinclude a low-power light sensor that helps to preserve the battery lifeof the camera. The low power light sensor may be low cost sensor that isoperated without initiating the high resolution sensor of the camerauntil movement detected by the camera meets a user set criterion.

The light sensor within the camera collimates light on to the differentregions of the field of view of the camera, and assess the amount oflight striking the different regions of the sensor. The light sensor ofthe camera may determine that a moving object is within the field ofview of the camera based on the amount of light striking the differentregions of the sensor. When the camera detects a moving object is withinthe field of view, the camera generates a first image at a first time.In some implementations, the camera may generate a plurality of imagesat the first time. The camera communicates the first image and theassociated image data to the monitor control unit 106. The image datamay include the timestamp associated with the captured image, the sizeof the image, and any other appropriate image data.

The monitor control unit 106 analyzes the first image (420) anddetermines that the first image includes a first object that likelycorresponds to a person based on analyzing the first image (430). Themonitor control unit 106 may identify features within the image of theobject that are used to determine whether the object is of a human formor is of an animal form. For example, the monitor control unit 106 mayidentify an elongated object with regions that are likely limbs as ahuman. The monitor control unit may identify any object that includes anumber of pixels higher than a threshold number of pixels as an adult.The monitor control unit 106 may identify any object that is taller thana threshold height as an adult. For examples, the monitor control unit106 may identify any object that is estimated as over three feet tall asan adult. In some implementations, the monitor control unit may use anyother suitable method to determine an object is likely an adult.

The monitor control unit 106 receives, from a camera at the property, asecond image generated at a second time and data indicating the secondlater time (440). The camera generates a second image at a second time,in some examples, the camera generates one or more additional images ofthe object detected within the field of the camera at different times.For example, the camera may generate an image of the object within thefield of view of the camera every 30 seconds or every 45 seconds. Insome examples, the camera generates an image every second and compareseach of the images to the previously generated image. The one or moreadditional images are communicated to the monitor control unit 106 alongwith the associated image data. The monitor control unit analyzes thesecond image (450), and determines that the second image includes asecond object that likely corresponds to a person (460). The monitorcontrol unit 106 identifies features within the second image that areassociated with a human form, and determines that the second imageincludes an object that is of a human form.

The monitor control unit compares the first object that likelycorresponds to a person to the second object that likely corresponds toa person (470), based on comparing the first object that likelycorresponds to a person to the second object that likely corresponds toa person, and based on a difference between the first time and thesecond later time, determining that a person is likely moving towardsthe camera (480). The monitor control unit 106 may compare the shape ofthe object in the first image to the shape of the object in the secondimage. The monitor control unit confirms the object in the first imageis the same object in the second image based on determining the shape ofthe object in the first image is the same as the shape of the object inthe second image. The monitor control unit 106 may compare the size ofthe object in the first image to the size of the object in the secondimage. For example, the monitor control unit may compare the number ofpixels of the image occupied by the object in the first image to thenumber of pixels of the image occupied by the object in the secondimage. The monitor control unit 106 confirms the object is likely movingtowards the camera based on the size of the object in the second imagebeing larger than the size of the object in the first image. The monitorcontrol unit 106 also confirms that the second image is captured at atime later than the first image.

The monitor control unit performs a monitoring system action based ondetermining that a person is likely moving towards the camera (490). Themonitor control unit performs a monitoring system action when a user setcriterion is meet. The user may set their user criterion through themonitoring system application on their user device. The user may set theone or more criterion required to prompt the monitoring system at theproperty to initiate the capture of high-resolution video data. Thecamera is configured to conserve the amount of power used, and onlyinitiates the capture of high resolution video data, a power heavyfunction, when a user criteria for detecting motion is meet.

The user may wish to receive a notification from the system when aperson is determined to be walking towards the property. The camera doesnot capture high resolution when a person is walking by the monitoredproperty or when an animal is walking towards the property. This featureallows the camera to reserve its battery power. In some implementations,when the monitor control unit determines that a person is likely movingtowards the camera, the monitor control unit communicates an alert tothe resident of the property. The monitor control unit may communicate anotification to the user device of the resident indicating that a personis approaching the property. In some examples, the notification mayinclude a stream of the video data that is captured by the camera at theproperty.

In some implementations, when the monitoring system at the property isunarmed, and the system determines that a person is moving towards thecamera, the monitor control unit automatically locks the door locks ofthe one or more exterior doors of the property, and arms the monitoringsystem. In some implementations, when the monitoring system at theproperty is armed away and the system determines that a person is movingtowards the camera, the monitor control unit may switch on one or morelights at the property. In some examples, the monitor control unit mayturn on a speaker located within the property, or switch on one or moresprinklers to simulate that someone is at the residence.

In some implementations, a user may set their user preference to receivenotifications from the system when an animal is determined as walkingtowards the camera. For example, the resident may own a cat that heallows to roam outside of the property and return through an animal doorat the property. In these examples, the camera may be positioned abovethe animal door. When the control unit determines the animal is walkingtowards the property, as the cat returns, the control unit initiates thecapture of video data and sends a notification to the resident thatincludes the video stream of the animal returning home safely. In someimplementations, when the system determines an animal is walking towardsthe property, the monitor control unit automatically opens the animaldoor. In some examples, where the resident does not own a pet and doesnot want animals on the lawn of the property, when the system determinesan animal is walking towards the property, the monitor control unitautomatically turns on one or more sprinklers.

In some implementations, the monitor control unit does not prompt amonitoring system action when the control unit determines that a personis walking by the property. In these implementations, the size of theobject in the first image and the size of the object in the second imageis the same as the object is traversing the field of view of the camera.In some implementations, the control unit does not prompt a monitoringsystem action when the control unit determines that an animal is walkingby the property.

The described systems, methods, and techniques may be implemented indigital electronic circuitry, computer hardware, firmware, software, orin combinations of these elements. Apparatus implementing thesetechniques may include appropriate input and output devices, a computerprocessor, and a computer program product tangibly embodied in amachine-readable storage device for execution by a programmableprocessor. A process implementing these techniques may be performed by aprogrammable processor executing a program of instructions to performdesired functions by operating on input data and generating appropriateoutput. The techniques may be implemented in one or more computerprograms that are executable on a programmable system including at leastone programmable processor coupled to receive data and instructionsfrom, and to transmit data and instructions to, a data storage system,at least one input device, and at least one output device. Each computerprogram may be implemented in a high-level procedural or object-orientedprogramming language, or in assembly or machine language if desired; andin any case, the language may be a compiled or interpreted language.Suitable processors include, by way of example, both general and specialpurpose microprocessors. Generally, a processor will receiveinstructions and data from a read-only memory and/or a random accessmemory. Storage devices suitable for tangibly embodying computer programinstructions and data include all forms of non-volatile memory,including by way of example semiconductor memory devices, such asErasable Programmable Read-Only Memory (EPROM), Electrically ErasableProgrammable Read-Only Memory (EEPROM), and flash memory devices;magnetic disks such as internal hard disks and removable disks;magneto-optical disks; and Compact Disc Read-Only Memory (CD-ROM). Anyof the foregoing may be supplemented by, or incorporated in,specially-designed ASICs (application-specific integrated circuits).

It will be understood that various modifications may be made. Forexample, other useful implementations could be achieved if steps of thedisclosed techniques were performed in a different order and/or ifcomponents in the disclosed systems were combined in a different mannerand/or replaced or supplemented by other components. Accordingly, otherimplementations are within the scope of the disclosure.

The invention claimed is:
 1. A monitoring system that is configured tomonitor a property, the monitoring system comprising: a camera locatedat the property and that is configured to generate image data, thecamera comprising a light detecting sensor that collimates light acrossregions of the sensor; and a monitor control unit comprising controlcircuitry that executes instructions to perform operations of themonitoring system, the monitor control unit being configured to: receivethe image data; determine a size of an object in the image data based onvariations in intensity of the light collimated across different regionsof the light detecting sensor, corresponding to a field of view of thecamera used to generate the image data; based on the size of the objectin the image data, determine that a person is likely moving towards theproperty; determine an arming status of the monitoring system and alocking status of an exterior door of the property; and based on theperson likely moving towards the property, the arming status of themonitoring system, and the locking status of the exterior door of theproperty, adjust the arming status of the monitoring system and thelocking status of the exterior door of the property.
 2. The monitoringsystem of claim 1, wherein the monitor control unit is configured to:based on the person likely moving towards the property, the armingstatus of the monitoring system, and the locking status of the exteriordoor of the property, provide, for output to the camera, a command toadjust a resolution of the generated image data.
 3. The monitoringsystem of claim 1, wherein the monitor control unit is configured to:based on the person likely moving towards the property, the armingstatus of the monitoring system, and the locking status of the exteriordoor of the property, provide, for output to a client device of aresident of the property, a notification indicating that a person islikely moving towards the property.
 4. The monitoring system of claim 1,wherein the monitor control unit is configured to: determine the armingstatus of the monitoring system and the locking status of the exteriordoor of the property by determining that the monitoring system is in anunarmed state and that the exterior door of the property is unlocked;and adjust the arming status of the monitoring system and the lockingstatus of the exterior door of the property by arming the monitoringsystem and locking the exterior door of the property.
 5. The monitoringsystem of claim 1, wherein the monitor control unit is configured to:receive additional image data; analyze the additional image data; basedon analyzing the additional image data, determine that an animal islikely in a vicinity of the property; and based on determining that theanimal is likely in the vicinity of the property, perform an action toencourage the animal to leave the property.
 6. The monitoring system ofclaim 1, wherein the monitor control unit is configured to: receiveadditional image data; analyze the additional image data; based onanalyzing the additional image data, determine that an additional personis likely moving lateral to the property; and based on determining thatthe additional person is likely moving lateral to the property, bypassperforming a monitoring system action.
 7. The monitoring system of claim6, wherein the monitor control unit is configured to: analyze theadditional image data by: determining that a first portion of theadditional image data includes a first representation of the additionalperson that comprises a first number of pixels; determining that asecond portion of the additional image data includes a secondrepresentation of the additional person that comprises a second numberof pixels; and determining that a difference between the first number ofpixels and the second number of pixels does not satisfy a thresholdnumber of pixels, wherein determining that the additional person islikely moving lateral to the property is based on determining that thedifference between the first number of pixels and the second number ofpixels does not satisfy the threshold number of pixels.
 8. Themonitoring system of claim 1, wherein the monitor control unit isconfigured to: determine the size of the object in the image data atleast by: determining that a first portion of the image data includes afirst representation of the person that comprises a first number ofpixels; determining that a second portion of the image data includes asecond representation of the person that comprises a second number ofpixels; and determining that a difference between the first number ofpixels and the second number of pixels satisfies a threshold number ofpixels, wherein determining that the person is likely moving towards theproperty is based at least on determining that the difference betweenthe first number of pixels and the second number of pixels satisfies thethreshold number of pixels.
 9. The monitoring system of claim 1, whereinthe camera includes (i) a first image sensor that collects image data ata first resolution and uses a first amount of power and (ii) a secondimage sensor that collects image data at a second, higher resolution anduses a second, greater amount of power.
 10. The monitoring system ofclaim 1, wherein the monitor control unit is configured to: based on theperson likely moving towards the property, the arming status of themonitoring system, and the locking status of the exterior door of theproperty, adjusting one or more lights at the property.
 11. Acomputer-implemented method performed using a monitoring system with acamera located at a property, the monitoring system being configured tomonitor the property, the method comprising: generating image data usinga light detecting sensor of the camera located at the property, whereinthe light detecting sensor collimates light across regions of thesensor; determining, by the monitoring system, a size of an object inthe image data based on variations in intensity of the light collimatedacross different regions of the light detecting sensor, corresponding toa field of view of the camera used to generate the image data; based onthe size of the object in the image data, determining, by the monitoringsystem, that a person is likely moving towards the property;determining, by the monitoring system, an arming status of themonitoring system and a locking status of an exterior door of theproperty; and based on the person likely moving towards the property,the arming status of the monitoring system, and the locking status ofthe exterior door of the property, adjusting, by the monitoring system,the arming status and the locking status of the exterior door of theproperty.
 12. The method of claim 11, comprising: based on the personlikely moving towards the property, the arming status of the monitoringsystem, and the locking status of the exterior door of the property,providing, by the monitoring system for output to the camera, a commandto adjust a resolution of the generated image data.
 13. The method ofclaim 11, comprising: based on the person likely moving towards theproperty, the arming status of the monitoring system, and the lockingstatus of the exterior door of the property, providing, by themonitoring system and for output to a client device of a resident of theproperty, a notification indicating that a person is likely movingtowards the property.
 14. The method of claim 11, wherein: determiningthe arming status of the monitoring system and the locking status of theexterior door of the property comprises determining that the monitoringsystem is in an unarmed state and that the exterior door of the propertyis unlocked; and adjusting the arming status of the monitoring systemand the locking status of the exterior door of the property comprisesarming the monitoring system and locking the exterior door of theproperty.
 15. The method of claim 11, comprising: receiving, by themonitoring system, additional image data; analyzing, by the monitoringsystem, the additional image data; based on analyzing the additionalimage data, determining, by the monitoring system, that an animal islikely in a vicinity of the property; and based on determining that theanimal is likely in the vicinity of the property, performing, by themonitoring system, an action to encourage the animal to leave theproperty.
 16. The method of claim 11, comprising: receiving, by themonitoring system, additional image data; analyzing, by the monitoringsystem, the additional image data; based on analyzing the additionalimage data, determining, by the monitoring system, that an additionalperson is likely moving lateral to the property; and based ondetermining that the additional person is likely moving lateral to theproperty, bypassing, by the monitoring system, performing a monitoringsystem action.
 17. The method of claim 16, wherein: analyzing theadditional image data comprises: determining that a first portion of theadditional image data includes a first representation of the additionalperson that comprises a first number of pixels; determining that asecond portion of the additional image data includes a secondrepresentation of the additional person that comprises a second numberof pixels; and determining that a difference between the first number ofpixels and the second number of pixels does not satisfy a thresholdnumber of pixels, wherein determining that the additional person islikely moving lateral to the property is based on determining that thedifference between the first number of pixels and the second number ofpixels does not satisfy the threshold number of pixels.
 18. The methodof claim 11, wherein: determining the size of the object in the imagedata comprises: determining that a first portion of the image dataincludes a first representation of the person that comprises a firstnumber of pixels; determining that a second portion of the image dataincludes a second representation of the person that comprises a secondnumber of pixels; and determining that a difference between the firstnumber of pixels and the second number of pixels satisfies a thresholdnumber of pixels, wherein determining that the person is likely movingtowards the property is based at least on determining that thedifference between the first number of pixels and the second number ofpixels satisfies the threshold number of pixels.
 19. The method of claim11, wherein the camera includes (i) a first image sensor that collectsimage data at a first resolution and uses a first amount of power and(ii) a second image sensor that collects image data at a second, higherresolution and uses a second, greater amount of power.
 20. The method ofclaim 11, comprising: based on the person likely moving towards theproperty, the arming status of the monitoring system, and the lockingstatus of the exterior door of the property, adjusting one or morelights at the property.